Speedup, Communication Complexity, and Blocking - A La Recherche du Temps Perdu
نویسندگان
چکیده
The paper investigates the time lost in a parallel computation due to sequential and duplicated work, communication and control, and blocking. It introduces the concept of relative speedup and proposes characterizations of parallel algorithms based upon the communication complexity and the blocking model. The paper discusses the impact of the processor's architecture upon the measured speedup. It shows that a large speedup may be due to an inefficient sequential computation, e.g., due to the cache management, rather than to an efficient parallel computation. A model of parallel computations which takes into account sequential and duplicated work, communication and control and blocking is presented. The paper shows that the scalability of a parallel computation is determined by the communication complexity. The model is used to predict the asymptotic behavior, the maximum speedup and the optimal number of processors. An incore 3-D FFT algorithm for distributed memory MIMD systems and a Chebychev iterative algorithm for solving a linear system of equations are used to illustrate the concepts introduced in this paper. ·Work supported in part by a grant from the National Science Foundation, CCR-9119388
منابع مشابه
On The Logic of Secrecy in À la recherche du temps perdu
n this article, the author links what he terms ‘logic of secrecy’ to Proust’s best known and celebrated work, À la recherche du temps perdu. The article explores the way in which the ‘holder’ and the ‘addressee’ of a secret can relate one to the other despite a fundamental state of separation and finds that the Recherche contains a great variety of examples in which different kinds of secrets a...
متن کاملThe Many Faces of the Kempner Number
In this survey, we present five different proofs for the transcendence of Kempner’s number, defined by the infinite series ∑∞ n=0 1 22 n . We take the opportunity to mention some interesting ideas and methods that are used for proving deeper results. We outline proofs for some of these results and also point out references where the reader can find all the details. À Jean-Paul Allouche, pour so...
متن کاملDe la théorie à l'application: VALLEX, une démarche exemplaire
VALLEX est le fruit du temps : le temps de réfléchir, le temps de tester, le temps de faire, le temps d’utiliser. VALLEX est le contre-exemple prototypique de tout ce que souhaitent les politiques actuelles de la recherche : c’est pour les chercheurs sérieux le réconfort d’apprécier la richesse qu’apportent la pérennité d’une équipe et de ses thèmes de recherche, l’effet cumulatif des connaissa...
متن کاملS-Step BiCGStab Algorithms for Geoscience Dynamic Simulations
In basin and reservoir simulations, the most expensive and time consuming phase is solving systems of linear equations using Krylov subspace methods such as BiCGStab. For this reason, we explore the possibility of using communication avoiding Krylov subspace methods (s-step BiCGStab), that speedup of the convergence time on modern-day architectures, by restructuring the algorithms to reduce com...
متن کاملCauses of Increased Intracranial Blood Flow Rate (Angiographic Study)
"Etude etiologique de la circulation ra.pide iutra-rena-le" Le but de l'angiographle renale n'est pas '.seulement le controle anatomique de l'organe, une etude physiologique (Hemodynamique) doit toujours etre prise en consideration. Le temps normal de la circulation intra-renale selon les differents auteurs varie entre 6 a 8, 8 a 10 et 10 a 12 secondes, mais le temps moyen est de 6 a 8 seco...
متن کامل